TITLE OF THE INVENTION 

Electronic Camera WM do^pfUsS^Jl 
A 

BACKGROUND OF THE INVENTION 

Field of the invention 

This invention relates to electronic cameras and, more particularly, to an 
electronic camera which compresses, frame by frame, image signals of a plurality of 
frames consecutively obtained in a snapshot or motion image recording mode thereby 
recording the compressed image signals onto a recording medium. 
Description of the prior art 

In the digital camera, when operating the shutter button, a subject image is taken 
by an image sensor, providing a camera signal. The obtained camera signal is subjected 
to signal processing, including color separation and YUV conversion. The image signal 
thus processed is thereafter recorded onto a recording medium through JPEG 
compression. 

In the case that the recording medium is a detachable medium, say a memory card, 
there is a need to ensure beforehand the number of recordable frames or still pictures. For 
achieving this, the compression ratio upon JPEG compression must be controlled on each 
still image to thereby reduce the size of a compressed image down to a predetermined 
target size or the smaller. 

Due to this, in a still image recording mode wherein one frame of still images is 
recorded in response to shutter button operation, an image signal is compressed with a 
predetermined compression ratio into a compressed image signal. Based on a size of the 
compressed image signal and a target size, calculated is an optimal compression ratio in 
order to compress the same image signal with an optimal compression ratio. 



In a snapshot or motion image recording mode, however, the control of a 
compression ratio in a similar way takes a long time in recording one frame of image 
signals, hence decreasing the number of shootable/recordable frames per unit time, i.e. 
the number of frames. This, however, makes it difficult in a motion image recording 
mode to realize smooth reproduction of motion images. Also, in a snapshot recording 
mode, the interval of picture taking is increased resulting in an increased possibility of 
failing to shoot optimal images. 

It is noted that, in image compression conforming to a JPEG format, the change of 
compression ratio is meant to change a Q factor, i.e. to change a quantization table. This 
technique is a well-known technology having been applied in most of the existing 
electronic cameras. 

SUMMARY OF THE INVENTION 

It is therefore an primary object of the present invention to provide an electronic 
camera which is capable of compressing an image signal down nearly to a target size in a 
brief time when performing continuous shooting on a subject. 

According to the present invention, an electronic camera which records, by 
separately compressing, a plurality of screens of image signals to a recording medium, 
comprising: an image sensor for outputting camera signals of a subject at a predetermined 
time interval; a processor for creating the plurality of image signals from the camera 
signals outputted from the image sensor; a calculator for calculating an optimal 
compression ratio for compressing a preceding one of the image signals to a target size; a 
compressor for compressing a current one of the image signals with the optimal 
compression ratio; and a recorder for recording to the recording medium the plurality of 
screens of compressed image signals created by the compressor. 



When corresponding camera signals to a subject image are outputted at a 
predetermined interval from the image sensor, the processor creates a plurality of screens 
of image signals from the camera signals. Meanwhile, the calculator calculates an 
optimal compression ratio for compressing a preceding one of the image signals to a 
desired size. The compressor compresses a current one of the image signals with the 
optimal compression ratio calculated by the calculator, i.e. optimal compression ratio for 
a preceding image signal. The plurality of screens of image signals thus created by the 
compressor are stored to a memory medium by the recorder. 

Because the current image signal is compressed according to an optimal 
compression ratio for the preceding image signal in this manner, it is possible to compress 
the image signals down to nearly a target size in a brief time when continuously shooting 
a subject. 

In one aspect of the invention, the calculator calculates the optimal compression 
ratio based on an arbitrary compression ratio, a signal size that the preceding image signal 
has been compressed with the arbitrary compression ratio, and the target size. 

In another aspect of the invention, a selector selects either one of a first recording 
mode or a second recording mode. Here, the first recording mode is to create within the 
recording medium a plurality of still image files separately accommodating the plurality 
of screens of the compressed image signals. The second recording mode is to create 
within the recording medium one motion image file collectively accommodating the 
plurality of screens of compressed image signals. The processor creates a first resolution 
of an image signal when the first recording mode is selected and a second resolution of an 
image signal when the second recording mode is selected, and the target size being 
different between the first recording mode and the second recording mode. In this case, 
the target size used to calculate an optimal compression ratio is different between the first 




recording mode and the second recording mode. 

In one embodiment, the first resolution is higher than the second resolution, and 
the target size in the first recording mode being greater than the target size in the second 
recording mode. 

5 In another embodiment, the processor creates one frame of image signal at a first 

predetermined interval when the first recording mode is selected and one screen of image 
signal at a second predetermined interval when the second recording mode is selected. 
Here, the first predetermined interval is longer than the second predetermined interval. 

The above described objects and other objects, features, aspects and advantages of 

- % g 10 the present invention will become more apparent from the following detailed description 

=3: 

f a of the present invention when taken in conjunction with the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 





Figure 1 


is 


a block diagram showing one embodiment of the present invention; 
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Figure 2 


is 


a block diagram showing one part of the Figure 1 embodiment; 




Figure 3 


is 


a flowchart showing one part of operation in the Figure 1 embodiment; 




Figure 4 


is 


a flowchart showing another part of operation in the Figure 1 




embodiment; 








Figure 5 


is 


a flowchart showing still another part of operation in the Figure 1 
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embodiment; 








Figure 6 


is 


a flowchart showing further part of operation in the Figure 1 




embodiment; 








Figure 7 


is 


a flowchart showing another part of operation in the Figure 1 




embodiment; 
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Figure 8 


is 


a flowchart showing still another part of operation in the Figure 1 
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embodiment; 

Figure 9 is a flowchart showing further part of operation in the Figure 1 
embodiment; and 

Figure 10 is a flowchart showing another part of operation in the Figure 1 
embodiment. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring to Figure 1, an electronic camera of this embodiment includes a CCD 
imager 1. The CCD imager 1 photoelectrical^ converts an incident subject image 
through the lens (not shown) into camera signals and outputs the camera signals with a 
VGA size (640 X 480 pixels) every l/15th of a second. The output camera signal is 
subjected to well-known noise removal and level adjustment by a CDS/AGC circuit 2, 
and then converted into camera data as a digital signal by an A/D converter 3. A signal 
processing circuit 4 in a following stage performs well-known signal processing, e.g. 
color separation and YUV conversion, on the camera data to thereby create image data 
comprising luminance data and 2-kinds chrominance data. The created image data is sent 
through a bus 7 to a memory control circuit 6. The image data is stored into an image data 
storage area 5a of an image memory 5 by the memory control circuit 6. 

Referring to Figure 2, the signal processing circuit 4 includes a high resolution 
signal processing circuit 4a and a low resolution signal processing circuit 4b. The high 
resolution signal processing circuit 4a performs color separation and YUV conversion on 
the VGA-sized camera data and outputs image data of the same VGA size, i.e. high 
resolution image data. On the other hand, the low resolution signal processing circuit 4b 
performs thinning-out on the VGA-sized camera data and then makes color separation 
and YUV conversion on that data, outputting image data of a QVGA size of (320 X 240 




pixels), i.e. low resolution image data. These high resolution signal processing circuit 4a 
and low resolution signal processing circuit 4b are selectively enabled by an instruction 
given from a system controller 13. 

The memory control circuit 6 reads out image data stored in the image data storage 
5 area 5a in response to a request sent from an NTSC encoder 8, and inputs it to the NTSC 
encoder 8 through a bus 7. The NTSC encoder 8 encodes the input image data by the use 
of an NTSC format, and provides an obtained composite video signal to a monitor 9. As 
a result, subject motion images (through-images) are displayed real time on the monitor 9. 
^pfS> 07/* image compression circuit 10, when receiving a compression command from 

10 the systemi controller 3, sends a request to the memory control circuit 6 to read out the 
image data stored in the image data storage area 5a. The image compression circuit 10 
compresses Uie image data read out by the memory control circuit 6 with using a JPEG 
format, according to the compression ratio data received together with a compression 
command. The image compression circuit 10 also sends a request to the memory control 
15 circuit 6 to write the compressed image data so that the memory control circuit 6 stores 
the compressedlimage data into the compression data storage area 5b of the image 
memory 5. Incidentally, when one frame of compressed image data has been stored, the 
memory control circuit 6 detects a size of the compressed image data and outputs the 
detected size information together with a compressed data storage ,cpmpletion)signal to 



20 the system controller 13. 

A. write control circuit 11 sends a request to the memory control circuit 6 to read 
out the compressed image data in response to a write command. Due to this, if the 
compressed image data is read out of the compressed data storage area, the write control 
circuit 11 creates within a detachable memory card 12 an image file storing this 

25 compressed image data. The write control circuit 11, when the write process has been 



-6- 



f 8 * 



completed, outputs a write completion signal. 

A mode change switch 14 is a switch that a user can manually select to any of a 
still image recording mode, snapshot recording mode and motion image recording mode. 
The mode selected is inputted as a mode select signal to the system controller 13. 
5 The system controller 13 receives a mode select signal inputted from the mode 

change switch 14 and enables required circuits for carrying out a process in a desired 
mode. The system controller 13 also conducts a picture taking process suitable for the 
mode, responsive to operation of a shutter button 15. Specifically, a flowchart shown in 
Figure 3 - Figure 10 is processed. Incidentally, the process of this flowchart is started 

10 when a camera power button (not shown) is turned on. 

The system controller 13 in step SI first carries out a monitor mode process. Due 
to this, a subject is shot by the CCD imager 1 and the corresponding camera data is 
converted into low resolution image data by the low resolution signal processing circuit 
4b. The converted image data is temporarily stored in the image data storage area 5a and 

15 thereafter outputted to the NTSC encoder 8. The NTSC encoder 8 creates a composite 
video signal based on the input image data and outputs a created composite video signal 
to the monitor 9. As a result, motion images are displayed real time on the monitor 9. 
XTn ^ ffS^/ Incidentally, in the monitor mode no compression and write commands are issued 
from the system controller 13 so that the image compression circuit 10 and the write 

20 control circuit lPwill not operate in the monitor mode. Due to this, motion images are 
merely displayed on\jie monitor 9 withoutfrecorded onto the memory card 12. 

The system controller 13 subsequently determines in step S3 whether the shutter 
button 15 was operated or not. If "YES", a current recording mode is determined in step 
S5 and step S7. Specifically, determination is made based on a mode select signal sent 

25 from the mode change switch 14 whether selected is a still image recording mode or a 
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continuous image recording mode such as a snapshot or motion image recording mode. 

In the case that a still image recording mode is selected, the system controller 13 
proceeds from the step S5 to step S9 to execute a still image recording process according 
to a subroutine shown in Figure 4 and Figure 5. Where a motion image recording mode is 
5 selected, the control proceeds from the step S7 to step Sll to execute a motion image 
recording process according to a subroutine shown in Figure 6 and Figure 7. Where a 
snapshot recording mode is selected, the control advances from the step S7 to step S13 to 
execute a snapshot recording mode according to a subroutine shown in Figure 8 to Figure 
10. After completing any of the processes of the steps S9 - SI, the system controller 13 

10 returns to the step SI. 

0 Inferring to Figure 4 and Figure 5, in a still image recording mode the high 
resolution srgnal processing circuit 4a is first enabled in step S21. Due to this, the camera 
data of subjectSshot by the CCD imager 1 is converted into image data without processed 
by thinning-out. The converted high resolution image data is stored by the memory 

15 control circuit 6 into\the image data storage area 5a of the image memory 5. When one- 
frame image data has Been stored after shutter button 15 operation, the memory control 
circuit 6 outputs an imagesdata storage completion signal to the system controller 13. In 
putted by an image data stooge completion signal, the system controller 13 in step S23 
determines "YES" and proceeofe to step S25. In this step, the memory control circuit 6 is 

20 instructed to block input of imagk data newly created by the signal processing circuit 4. 
As a result, the image data storage area 5a keeps holding same image data. 

In step S27 the image compression circuit 10 is instructed to effect compression 
with a predetermined compression ratio. Responsive to this compression command, the 
image compression circuit 10 fetches the image data stored in the image data storage area 

25 5a and compresses the image data with a predetermined compression ratio. The image 
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compression circuit 10 also stores the compressed image data into the compression data 
storage area 5b. After the compressed image data has been stored, the memory control 
circuit 6 outputs size information of this compressed image data and a compressed data 
storage completion signal to the system controller 13. 
5 Given a compressed image data storage completion signal, the system controller 

13 determines "YES" in step S29. In step S31 an optimal compression ratio is calculated 
according to Equation 1. 



[Equation 1] 

10 Optimal Compression Ratio = (Compressed Image Data Size /Target Size) 

M X Predetermined Compression Ratio. 

m 

% 4 That is, the size information on the compressed image data given from the 

^ memory control circuit 6 is divided by a target size, and a resulting divided value is 

^ 15 multiplied by the predetermined compression ratio used in the step S27. This provides 

^3 calculation of a compression ratio that can reduce the compressed data size down to a 

target size, i.e. an optimal compression ratio. 

After determining an optimal compression ratio as above, the system controller 13 
advances to step S33 where it instruct the image compression circuit 10 to conduct 
20 compression with the optimal compression ratio. The image compression circuit 10, in 
turn, fetches compressed data from the image data storage data 5a similarly to the above, 
and performs compression on this image data with the optimal compression ratio. 
Furthermore, the created compressed image data is written to the compression data 
storage area 5b. When completing the writing, the memory control circuit 6 outputs a 
25 compressed data storage signal and compressed image data size information (target size 
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information) to the system controller 13. 

When a compressed data storage signal is outputted, the system controller 13 in 
step S35 determines "YES" and in the following step S37 instructs the write control 
circuit 37 to write the compressed image data. In response to the write instruction, the 
write control circuit 1 1 fetches the compressed image data out of the compressed data 
storage area 5b and creates within the memory card 12 a still image file storing this 
compressed image data. When the writing is completed, the write control circuit 11 ■ 
outputs a write completion signal to the system controller 13. 

The system controller 13, when receiving a write completion signal from the write 
control circuit 11, determines "YES" in step 39, then returning to the main routine, i.e. 
returns to the step SI. 

In the step SI a monitor mode process is executed. Accordingly, in the signal 
processing circuit 4 the low resolution signal processing circuit 4b is again enabled. 
Meanwhile, the memory control circuit 6 stores the image data outputted from the signal 
processing circuit 4 into the image data storage area 5a. The NTSC encoder 8 creates a 
composite video signal based on the image data stored in the image data storage area 5a. 
On the other hand, the image compression circuit 10 and write control circuit 11 are 
disabled. As a result, subject motion images are displayed on the monitor 9. 

Incidentally, in a still image recording mode the image data within the image data 
storage area 5a is suspended from being updated. Accordingly, on the monitor is 
displayed an image (freeze image) corresponding to the image data stored within the 
image data storage area 5a. 

Referring to Figure 6 and Figure 7, in a motion image recording mode the 
compression ratio is first initialized in step S31. That is, an initial compression ratio P0 is 
set. The system controller 13 in step S33 determines whether an image data storage 
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completion signal has been inputted from the memory control circuit 6 or not. When 
determined "YES", in step S35 an input blockage command is issued to the memory 
control circuit 6. Due to this, the image data in a first frame after operating the shutter 
button 15 is kept held within the image data storage area 5a. 

ientally, in a motion image recording mode the low resolution signal 
processing circuit 4b having been enabled in the monitor mode is used continuously. The 
image data storage area is written by image data with a low resolution (VGA size). 

The system controller 13 in step S37 subsequently instructs the image 
compression circuit 10 to perform compression with the compression ratio P0. In 

10 response to this compression command, the image compression circuit 10 fetches image 
data out of the image data storage area 5a and performs JPEG compression on this image 
data with compression ratio P0. The image compression circuit 10 also writes the created 
compressed image data to the compressed data storage area 5b. Incidentally, the reading 
of the image data out of the image data storage area 5a and the writing of the compressed 

15 image data to the compressed data storage area 5b are carried out by the memory control 
circuit 6, as stated above. Meanwhile, when the compressed image data has been written, 
the memory control circuit 6 detects a size SO of this compressed image data and outputs 
size information together with a compressed data storage completion signal to the system 
controller 13. 

20 When a compressed data storage completion signal is outputted, the system 

controller 13 in step S39 determines "YES". Then, in step S41 a count value n of the 
counter 13a is set to "1", and in step S43 a compression ratio PI (1; count value) is 
calculated according to Equation 2. 

25 [Equation 2] 
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Compression Ratio PI = (Compressed Image Data Size SO / Target Size) 
X Initial Compression Ratio PO 



Jj^*d /3 £^p> Afer an optimal compression ratio has been determined, the system controller 13 
5 in step S45 instructs the memory control circuit 6 to cancel the input blockage. This 

recording nrode requires to record motion images. Accordingly, cancellation of the input 
blockage is instructed in order to write the image data in each frame onto the image data 
storage area qa. Hereinafter no input blockage will be issued to the memory control 
circuit 6. 

10 Incidentally, actually recorded to the memory card 12 is the image data obtained 

after issuing such an input blockage canceling command. 

If the image data in the first frame after canceling the input blockage is stored in 
the image data storage area, the memory control circuit 6 outputs an image data storage 
completion signal. Thereupon, the system controller 13 in step S47 determines "YES" 

15 and in step S49 instructs the image compression circuit 10 to perform compression with a 
compression ratio Pn (first frame; n = 1). The image compression circuit 10 fetches 
image data from the image data storage area 5a and performs JPEG compression on it 
with a compression ratio PO. Then, the created compressed image data is written to the 
compressed data storage area 5b. When the compressed image data has been written, the 

20 memory control circuit 6 detects a size Sn of this compressed image data and outputs size 
information together with a compressed data storage completion signal to the system 
controller 13. 

Given a compressed data storage completion signal, the system controller 13 in 
step S51 determines "YES" and issues a write command to the write control circuit 11. 
25 The write control circuit 11 creates a motion image file within the memory card 12 in 
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response to this write command, and accommodates compressed image data of the 
created motion image file. At this time, the count value n of the counter 13a, i.e. image 
no., is also recorded related to the compressed image data. When the write operation like 
this has been completed, the write control circuit 11 outputs a write completion signal to 
the system controller 13. 
4% His noted that such motion image file is created by the write control circuit 11 
only when\ first write command is outputted. When given a second or later write 
command, compressed image data will be accommodated in an already-prepared motion 
image file. DuAto this, obtained within a same motion image file a plurality of frames of 
compressed imagSt data related to image nos. 

When a write completion signal is outputted, the system controller 13 advances 
from step S55 to step S57 to determine whether the shutter button 15 is still on or not. If 
the shutter button 15 is on, then in step S59 the count value n is compared with the 
number of maximum recordable frames M. If n < M, the control proceeds to step S61. 
Incidentally, if the shutter button 15 is off or on with n = M, the control returns to the main 
routine. As a result, the motion image recording mode is ended. 

In step S61 the counter 13a is incremented, and in the following step S63 a 
compression ratio Pn is determined according to Equation 3. After determining a next 
compression ratio in this manner, the system controller 13 returns to the step S47 to 
execute again the process similar to the above. 

[Equation 3] 

Compression Ratio Pn = (Compressed Data Size Sn-1 / Target Size) 
X Compression Ratio Pn-1 
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The compression ratio determined by Equation 2 or 3 is one that can compress the 
image data in a previous frame into a target size. That is, Equation 2 can calculate a 
compression ratio PI at which the image data of Oth frame can be reduced to a target size. 
With this compression ratio PI the image data in the first frame is compressed. 
Meanwhile, Equation 3 can determine a compression ratio Pn with which the image data 
in a (n-l)th-frame can be reduced down to a target size. With this compression ratio Pn 
the image data in an n-th frame is compressed. Accordingly, even if the image data in a 
current frame be compressed with this compression ratio, the resulting compressed image 
data is not necessarily put within a target size. 

However, camera signals are outputted from the CCD imager 1 at an interval of 
l/15th of a second. Accordingly, if panning or tilting is conducted within a duration of 
approximately l/15th of a second, no significant difference occurs between the object 
image in the preceding frame and the subject image in the current frame. Consequently, 
the current frame image data is compressed with an optimal compression ratio or the 
preceding frame image data, the current frame image data can be put nearly within a 
target size. 

Referring to Figure 8 to Figure 10, the snapshot recording process is similar to the 
motion image recording process shown in Figure 6 and Figure 7 except in that in step S71 
the high resolution signal processing circuit 4a is enabled, in step S89 the memory control 
circuit 6 is instructed to cancel input blockage, in step S107 the memory control circuit 6 
is instructed to block against input, in steps S83 and S105 a target size used in 
compression ratio calculation is greater than a target size used upon motion image 
recording, and the write control circuit 11 creates one still image file accommodating 
one-frame compressed image data responsive to a write command. Accordingly, 
duplicated explanations will be omitted on the similar points. 
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In step S71 the high resolution signal processing circuit 4a is enabled, and in step 
S95 one still image file is created in the memory card 12 each time a write command is 
issued. Accordingly, in the snapshot recording mode the image data of VGA is recorded 
frame by frame onto the memory card 12. Also, in the snapshot recording mode, in order 
5 to record image data at an interval of several frames, in step S107 an input blocking 
command is given to the memory control circuit 6 and in step S89 an output blockage 
canceling command is supplied to the same memory control circuit 6. 

According to present embodiment, when a still image recording mode is selected, 
the image data is compressed with a predetermined compression ratio thus providing 
10 compressed image data. Based on a size of compressed image data and the above 
predetermined compression ratio and a target size, an optimal compression ratio is 
calculated that can reduce the image data down to a target size. Thereafter, the same 
image data is again compressed with the optimal compression ratio whereby the obtained 
compressed image data is recorded to the memory card. 

l&^pt \^hen a motion image or snapshot recording mode is selected, there is no 
sufficient time for performing compression twice as conducted in the still image 
recording mode. Consequently, calculated is an optimal compression ratio for the image 
data createdlin the preceding frame so that the image data created in the present time is 
compressed with this optimal compression ratio for the preceding time. Because no 
20 significant difference occurs between the subject images in succeeding several frames, 
the image data compressed with the optimal compression ratio for the preceding time has 
a size approximate to a target size. Moreover, because compression may be satisfactorily 
made once per frame, there is less possibility tha/Weakdown occu^during recording the 
image data. 

25 If as well known the image file recorded on the memory card 12 is transferred to a 
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personal computer and the compressed image data thereof is decompressed by the use of 
predetermined application software, then the shot image is reproduced on the display. As 
for a motion image file, it is possible to display motion images on the display by 
reproducing compressed image data at a predetermined time interval according to image 
nos. assigned to the header. Incidentally, it is needless to say that still or motion images 
can be reproduced on the monitor 9 if such image decompression function is provided in 
the camera main body. 

ikeanwhile, if in the Figure 1 block diagram the image memory 5 is configured by 
an SDRAM, the data transfer through the bus 7 is usually effected by DMA. Furthermore, 
although at was explained that image display on the monitor 9 be necessarily made 
simultaneous with turning on the power to the camera, a monitor ON/OFF switch may be 



provided 



or allowing choice by an operator. Furthermore, a character representative of 



not recordable may be displayed not only on the monitor 9 but also on a remaining power 
4ndicaton21. 

Although the present invention has been described and illustrated in detail, it is 
clearly understood that the same is by way of illustration and example only and is not to 
be taken by way of limitation, the spirit and scope of the present invention being limited 
only by the terms of the appended claims. 



- 16- 



